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Abstract 

We have performed a search for CPT violation in neutral charm meson oscillations. 
While flavor mixing in the charm sector is predicted to be small by the Standard 
Model, it is still possible to investigate CPT violation through a study of the proper 
time dependence of a CPT asymmetry in right-sign decay rates for — > K~Tr~^ and 
D'^ K^TT^ . This asymmetry is related to the CPT violating complex parameter 
^ and the mixing parameters x and y: Aqpt cx Re^y — Im^z. Our 95% confidence 
level limit is -0.0068 < Re^y-Im^x < 0.0234. Within the framework of the 
Standard Model Extension incorporating general CPT violation, we also find 95% 
confidence level limits for the expressions involving coefficients of Lorentz violation 
of (-2.8 < iV(x,y,5)(Aao + 0.6Aaz) < 4.8) x lO-^^ GeV, (-7.0 < N{x,y,5)l^ax < 
3.8) X 10-16 GeV, and (-7.0 < N{x,y,S)AaY < 3.8) x 10-^^ GeV, where N{x,y,S) 
is the factor which incorporates mixing parameters x, y and the doubly Cabibbo 
suppressed to Cabibbo favored relative strong phase 5. 
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1 Introduction 



The combined symmetry of charge conjugation (C), parity (P), and time rever- 
sal (T) is beheved to be respected by all local, point-like, Lorentz covariant field 
theories, such as the Standard Model. However, extensions to the Standard 
Model based on string theories do not necessarily require CPT invariance, and 
observable efi^ects at low-energies may be within reach of experiments studying 
fiavor oscillations [1,2]. A parametrization [3] in which CPT and T violating 
parameters appear has been developed which allows experimental investiga- 
tion in many physical systems including atomic systems. Penning traps, and 
neutral meson systems [4]. Using this parameterization we present the first 
experimental results for CPT violation in the charm meson system. 

Searches for CPT violation have been made in the neutral kaon system. Using 
an earlier CPT formalism [5,6], KTeV reported a bound on the CPT figure of 
merit tk ^ Im^^o —m-j^a\/mj^o < (4.5 ±3) x 10^^^ [7]. A more recent analysis, 
using framework [3] and more data extracted limits on the coefficients for 
Lorentz violation of Aox, Aoy < 9.2 x lO^^^ GeV [8]. CPT tests in S° meson 
decay have been made by OPAL at LEP [9] , and by Belle at KEK which has 
recently reported tb = \mBO — m-^o\/mBO < 1.6 x 10"^'^ [10]. 

To date, no experimental search for CPT violation has been made in the charm 
quark sector. This is due in part to the expected suppression of — os- 
cillations in the Standard Model, and the lack of a strong mixing signal in the 
experimental data. Recent mixing searches include a study of lifetime differ- 
ences between charge-parity (CP) eigenstates [11,12,13], a study of the time 
evolution of decays by CLEG [14] and a study of the doubly Cabibbo sup- 
pressed ratio (-Rdcs) for the decay K'^7r~ [15]. Even without knowledge 
of the mixing parameters, one can investigate CPT violation through a study of 
the time dependence of decays. The time evolution of neutral-meson state 
is governed by a 2 x 2 effective Hamiltonian A in the Schrodinger equation. 
Indirect CPT violation occurs if and only if the difference of diagonal elements 
of A is nonzero. The complex parameter ^ controls the CPT violation and is 
defined as ^ = AA/AA, where AA = An — A22 and AA is the difference in the 
eigenvalues. ^ is phenomenologically introduced and therefore independent of 
the model. Time dependent decay probabilities into right-sign {D^ K^ti^) 
and wrong-sign decay modes (wrong sign is used here in the context of decays 
via mixing, — > — > K'^'k") for neutral mesons which express the CPT 
violation have been developed in a general parametrization [3]. For the decay 
of a to a right-sign final state /, the time dependent decay probability is: 



P;(t)^|(/|T|D°(t))P = l|Fpexp(-|t) 

X [(1 + |^HcoshA7t/2 + (1 - I^HcosAmt 
-2Re ^ sinhA7t/2 - 2Im ^ sinAmt] . (1) 
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The time dependent probability for the decay of a D° to a final state /, Pj{t), 
may be obtained by making the substitutions ^ and F F in the 

above equation. F* = F is strictly true if CP (CPT) is not directly violated, 
which experimental evidence suggests is very nearly true in charm decays. 
F — {f\T\D^) represents the basic transition amplitude for the decay ^ f , 
A7 and Am are the differences in physical decay widths and masses for the 
propagating eigenstates and can be related to the usual mixing parameters [12] 
X = AM/r = —2 Am/7, y = Ar/2r = A7/7, and 7 is the sum of the physical 
decay widths. Expressions for wrong-sign decay probabilities involve both CPT 
and T violation parameters which only scale the probabilities, leaving the 
shape unchanged. Using only right-sign decay modes, and assuming neglible 
direct CPT violation, the following asymmetry can be formed, 

Pj{t) - PAt) 

which is sensitive to the CPT violating parameter ^: 

2Re^ sinhA7t/2 + 21m ^ sinAmt 
" (1 + |eP)coshA7t/2 + (1 - lencosAmt" ^ ' 



Experiments show that x,y mixing values are small (< 5%). Equation 3, for 
small X, y and t, reduces to: 

Acpt(^) = (ReCy-Imex) Ft (4) 



2 Experimental and analysis details 



In this paper we search for a CPT violating signal using data collected by 
the FOCUS Collaboration during an approximately twelve month time pe- 
riod in 1996 and 1997 at Fermilab. FOCUS is an upgraded version of the 
E687 spectrometer. Charm particles are produced by the interaction of high 
energy photons (average energy ^180 GeV for triggered charm states) with 
a segmented BeO target. In the target region, charged particles are tracked 
by up to sixteen layers of microstrip detectors. These detectors provide ex- 
cellent vertex resolution. Charged particles are further tracked by a system 
of five multi-wire proportional chambers and are momentum analyzed by two 
oppositely polarized large aperture dipole magnets. Particle identification is 
accomplished by three multi-cell threshold Cerenkov detectors [16], two elec- 
tromagnetic calorimeters, an hadronic calorimeter and muon counters. 

We analyze the two right-sign hadronic decays K^n^ and K~^7r~ . 

We use the soft pion from the decay D*^ D^n^ to tag the flavor of the D at 
production, and the kaon charge in the decay — > K~7t~^ to tag the D flavor 
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at decay. K^n'^ events are selected by requiring a minimum detachment 

i of the secondary (decay) vertex from the primary (production) vertex of 5 o"^, 
where cr^ is the calculated uncertainty of the detachment measurement. The 
primary vertex is found using a candidate driven vertex finder which nucleates 
tracks about a "seed" track constructed using the secondary vertex and the D 
momentum vector. Both primary and secondary vertices are required to have 
fit confidence levels greater than 1%. The D*-tag is implemented by requiring 
the D* — mass difference be within 3 MeV/c^ of the nominal value [17]. A 
X^-like variable called Wj = -2 log(hkelihood), where i ranges over electron, 
pion, kaon and proton hypotheses is used for particle identification [16]. For 
the K and the tt candidates we require Wi to be no more than four units 
greater than the smallest of the other three hypotheses {Wi — Wmin < 4) 
which eliminates candidates that are likely to be mis-identified. In addition, 
daughters must satisfy the slightly stronger Kit separation criteria W^^ — Wk > 
0.5 for the K and Wk — Wj^ > —2 for the tt. Events in which the final state 
K~TT~^ is identified as 7r~K~^ and vice versa are removed by imposing a hard 
Cerenkov cut on the sum of the two separations {(Wn — Wk)k + {Wk — 
Wt^)t^ > 8). Ktt pairs with highly asymmetrical momenta are more likely 
to be background than signal. A cut is made on the momentum asymmetry. 
Pa — I {Pk — P-k) I {Pk + P-k) I , to reject these candidates. The best background 
rejection is achieved by applying the cut in the following way, P{D^) > —160+ 
280 X Pa, where P{D^), Pk and P^^ are the momenta of the D and the daughter 
kaon and pion respectively. To avoid large acceptance corrections due to the 
presence of a trigger counter downstream of the silicon detector, we impose a 
fiducial cut on the location of the primary vertex. Figure 1 shows the invariant 
mass distribution for D*-taggcd, right-sign decays — >■ K~t:^ and — >■ 
K^-K^ . A fit to the mass distribution is carried out where a Gaussian function 
for the signal and a second-order polynomial for the background is used. The 
fit yields 17227 ± 144 and 18 463 ± 151 W signal events. 



The proper time decay distribution is distorted by imposing a detachment 
cut between the primary and secondary vertices. The reduced proper time, 
defined as t' = {i — Nai) / {(3jc) where i is the distance between the primary 
and secondary vertex, cr^ is the resolution on i, and is the minimum detach- 
ment cut applied, removes this distortion. We chose N=5 such that signal to 
background ratio was maximal. A simulation study was done measuring the 
differences in measured values of Acpt and C, using t' in place of t in Equa- 
tion 5 and Equation 4. The differences were found to be negligible compared 
to other systematic uncertainties. We plot the difference in right-sign events 
between and in bins of reduced proper time t'. The background sub- 
tracted yields of right-sign and were extracted by properly weighting 
the signal region (— 2o", +2(t), the low mass sideband {—7a, —3a) and high 
mass sideband {+3a, +7a), where a is the width of the Gaussian. For each 
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Fig. 1. Invariant mass of {if^ K~tt^ (a); K^tt~ (b)) for data (points) 

fitted with a Gaussian signal and quadratic background (solid line). The vertical 
dashed lines indicate the signal region, the vertical dotted lines indicate the sideband 
region. 

data point, these yields were used in forming the ratio: 



^CPT(t') = - 



Y{t') 



nt'm 



Y{t')+Y{t')'p; 



(5) 



where Y{t') and Y{t') are the yields for D° and D° and fit'), fit') are their 
respective correction functions. The functions f{t') and f{t') account for geo- 
metrical acceptance, detector and reconstruction efficiencies, and absorption of 
parent and daughter particles in the nuclear matter of the target. The correc- 
tion functions are determined using a detailed Monte Carlo (MC) simulation 
using PYTHIA [18]. The fragmentation is done using the Bowler modified 
Lund string model. PYTHIA was tuned using many production parameters 
to match various data production variables such as charm momentum and 
primary multiplicity. The shapes of the fit') and fit') functions are obtained 
by dividing the reconstructed MC t' distribution by a pure exponential with 
the MC generated lifetime. The ratio of the correction functions, shown in 
Figure 2(a), enters explicitly in Equation 5 and its effects on the asymmetry 
are less than 1.3% compared to when no corrections are applied. The FOCUS 
data contains more than decays due to production asymmetry [19]. The 
effect on the ^cpt distribution is to add a constant offset, which is accounted 



6 



for in the fit. 



3 Fitting for the Assymmetry 



The ^CPT data in Figure 2(b) are fit to a fine using the form of Equation 4 
plus a constant offset. The value of F used in the fit is F = 1.6 x 10~^^ GeV. 
The result of the fit is Re^ y - Im^ x = 0.0083 ± 0.0065. 
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Fig. 2. (a) The ratio of the corrections; (b) Aqpt as a function of reduced proper 
time. The data points represent the ^cpt as given in Equation 5 and the sohd hne 
represent the fit given in functional form by Equation 4; (c) Re^ as a function of 
Greenwich Mean Sidereal Time (GMST). 
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4 Lorentz Violation 



Any CPT and Lorentz violation within the Standard Model is described by 
the Standard Model Extension (SME) proposed by Kostelecky at al. [20]. In 
quantum field theory, the CPT violating parameter ^ must generically depend 
on lab momentum, spatial orientation, and sidereal time [21,3]. The SME can 
be used to show that Lorentz violation in the D system is controlled by the 
four vector Aa^. The precession of the experiment with the earth relative to 
the spatial vector Aa modulates the signal for CPT violation, thus making 
it possible to separate the components of Aa^^. The coefficients for Lorentz 
violation depend on the flavor of the valence quark states and are model 
independent. In the case of FOCUS, where mesons in the lab frame are 
highly collimated in the forward direction and under the assumption that 
mesons are uncorrelated, the ^ parameter assumes the following form [3]: 



= ^[^«o + /3AazCosx 
+/3sinx(AaysinQ£+ AoxCOsQf)]. (6) 



VL and i are the sidereal frequency and time respectively, X, Y, Z are non- 
rotating coordinates with Z ahgned along the Earth's rotation axis, AA = 
V{x — iy), and 7(p) = ^JY^r^^^Jn^o. Binning in sidereal time i is very 
useful because it provides sensitivity to components Aa^ and Aay. Since 
Equation 15 of Reference [3] translates into 'Rc^y — \m.^x = 0. setting limits 
on the coefficients of Lorentz violation requires expanding the asymmetry in 
Equation 3 to higher (non- vanishing) terms. In addition, the interference term 
of right-sign decays with the doubly Cabibbo suppressed (DCS) decays must 
also be included since it gives a comparable contribution. One can follow the 
procedure given by equations [16] to [20] of Reference [3] where the basic 
transition amplitudes < /]T|P° > and < /]T|P° > are not zero but are DCS 
amphtudes. After Taylor expansion the asymmetry can be written as: 



Rei{x^ + y^){t/Tf 



2x 

xy I 

(V ^) + y -Rdcs {x cos6 + y sin 6) 



(7) 



where -Rdcs is the branching ratio of DCS relative to right-sign decays and 5 
is the strong phase between the DCS and right-sign amplitudes. 
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5 Fitting for LV Pcirameters 

We searched for a sidereal time dependence ^ by dividing our data sample 
into four- hour bins in Greenwich Mean Sidereal Time (GMST) [22], where for 
each bin wc repeated our fit in t' using the asymmetry given by Equation 7 
and extracted Re,^. The value of V-Rdcs used in the fit is taken from Ref- 
erence [17] and it is 0.06. The resulting distribution, shown in Figure 2(c), 
was fit using Equation 6 and the results for the expressions involving coeffi- 
cients of Lorentz violation in the SME were Cqz = N{x, y, 5)(Aao+0.6 Aa^) = 
(l.Oil.l) X 10"^^ GeV, Cx = N{x, y, 5)Aax = (-1.6d=2.0) x 10"^^ GeV, and 
Cy = N{x,y,6)AaY = (-1.6 ±2.0) x lO^^^ GeV, where N{x,y,6) = [xy/3 + 
0.06 {x cos 5 + y sin 5)] is the factor which carries the x,y and 6 dependence. 
The angle between the FOCUS spectrometer axis and the Earth's rotation axis 
is approximately x — 53°(cosx = 0.6). We average over all momentum so 
(lip)) ~ 7((p)) = 39 and (3 = 1. We also touched base with the previous mea- 
surements for the kaon Tk and B meson by constructing a similar quantity 
td [6],rs= lAAI/m^o = P^AaJmo^ = \^\\AX\ = 7(p)|Aao + 0.6 Aaz|/mDO. 
The result for N{x,y,S)rD is: N{x,y,5)rD = (2.3 ± 2.3) x 10-^^ GeV. Al- 
though it may seem natural to report rjj, the parameter (and r^, tb) has a 
serious defect: in quantum field theory, its value changes with the experiment. 
This is because it is a combination of the parameters Aa^ with coefficients 
controlled by the meson energy and direction of motion. The sensitivity 
would have been best if x = 90°. 



6 Systematic Errors 

Previous analyses have shown that MC absorption corrections are very small 
[11]. The interactions of pions and kaons with matter have been measured 
but no equivalent data exists for charm particles. To check any systematic 
effects associated with the fact that the charm particle cross section is unmea- 
sured, we examined several variations of D'^ and cross sections. The stan- 
dard deviation of these variations returns systematic uncertainties of ±0.0017, 
±0.3 x 10-^6 GeV, ±0.0 x 10"^^ GeV, and ±0.1 x 10"^^ GeV to our measure- 
ments of Re^ y — Im^ x, Cqz, Cx, and Cy respectively. 

In a manner similar to the S-factor method used by the Particle Data group 
PDG [17] we made eight statistically independent samples of our data in order 
to look for systematic effects. We split the data in four momentum ranges and 
two years. The split in year was done to look for effects associated with target 
geometry and reconstruction due to the addition of four silicon planes near the 

^ Sidereal time is a time measure of the rotation of the Earth with respect to the 
stars, rather than the Sun. Sidereal day is shorter than the normal solar day by 
about 4 minutes. 
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targets in January, 1997 [23]. Wc found no contribution to our measurements 
of Re^ y — ImC, x and Cqz- The contributions for Cx and Cy were ±1.3 x 
10-16 GeV and ±1.6 x lO'^*^ GeV respectively. 

We also varied the bin widths and the position of the sidebands to assess the 
validity of the background subtraction method and the stability of the fits. 

The standard deviation of these variations returns systematic uncertainties of 
±0.0012, ±0.3 X 10-16 GeV, ±0.9 x lO-^^ GeV, and ±0.5 x lO^^^ QeV to our 
measurements of Re.^ y — Im^ a;, Cqz, Cx, and Cy respectively. 

Finally, to uncover any unexpected systematic uncertainty, we varied our 
i/a^ and W^^ — Wk requirements and the standard deviation of these vari- 
ations returns systematic uncertainties of ±0.0036, ±1.5 x lO^^^ GeV, ±1.0 x 
10-16 GeV, and ±1.1 x lO-^^ GeV to our measurements of Re^ y — Im^ x, 
Cqz-i Cx, and Cy respectively. 

Contributions to the systematic uncertainty are summarized in Table 1 and 
Table 2. Taking contributions to be uncorrelated we obtain a total systematic 
uncertainty of ±0.0041 for Rc^y - Im^x, ±1.6 x lO-^^ GeV for Cqz, ±1-9 x 
10-16 GeV for Cx, and ±2.0 x 10-16 GeV for Cy. 

Table 1 

Contributions to the systematic uncertainty. 



Contribution 


Re^y — Im ^ x 


Cx (GeV) 


Absorption 


±0.0017 


±0.0 X 10-16 


Split sample 


±0.0000 


±1.3 X 10-16 


Fit variant 


±0.0012 


±0.9 X 10-16 


Cut variant 


±0.0036 


±1.0 X 10-16 


Total 


±0.0041 


±1.9 X 10-16 



Table 2 

Contributions to the systematic uncertainty. 



Contribution 


Coz (GeV) 


Cy (GeV) 


Absorption 


±0.3 X 10-16 


±0.1 X 10-16 


Split sample 


±0.0 X 10-16 


±1.6 X 10-16 


Fit variant 


±0.3 X 10-16 


±0.5 X 10-16 


Cut variant 


±1.5 X 10-16 


±1.1 X 10-16 


Total 


±1.6 X 10-16 


±2.0 X 10-16 
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7 Summciry 



We have performed the first search for CPT and Lorentz violation in neu- 
tral charm meson oscillations. We have measured Re^y — Im^x = 0.0083 ± 
0.0065 ± 0.0041 which lead to a 95% confidence level hmit of -0.0068 < 
Re^y — Im,^x < 0.0234. As a specific example, assuming x = or Im^ = 
and y = 1%, one finds Re.^ = 0.83 ± 0.65 ± 0.41 with a 95% confidence level 
hmit of -0.68 < Re^ < 2.34. Within the Standard Model Extension, we 
set three independent first limits on the expressions involving coefficients of 
Lorentz violation of (-2.8 < N{x,y,5){Aao + 0.6 Aa^) < 4.8) x 10"^^ GeV, 
(-7.0 < N{x,y,6)Aax < 3.8) x lO^^^ GeV, and (-7.0 < N{x,y,5)AaY < 
3.8) X 10^^® GeV. As a specific example, assuming x = 1%, y = 1% and 
S — 15° one finds the 95% limits on the coefficients of Lorentz violation of 
(-3.7 < Aao+0.6 Aaz < 6.5) x 10"^=^ GeV, (-9.4 < Aax < 5.0) x 10-^^ GeV, 
and (—9.3 < Aay < 5.1) x 10~^^ GeV. The measured values are consistent 
with no CPT or Lorentz invariance violation. 
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